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Abstract — For effective smart media service, a reliable and 
confidential context recognition is required to prepare and react 
properly. However, it is difficult to achieve a higher confidence 
level for several reasons. First, raw data from multiple sensors 
have different degrees of uncertainty. Second, generated contexts 
can indicate conflicting results, even though they are acquired by 
simultaneous operations. In this paper, we demonstrate an 
Evidential Fusion Network (EFN) based context reasoning for 
smart media service. For this we conduct the context 
classification and state-space based context modelling. Then, we 
perform the static evidential fusion process (SEFP) to obtain a 
higher confidence level of contextual information. It processes 
sensor data with an evidential form based on the Dezert- 
smarandache theory (DSmT). The execution with proposed 
example scenario demonstrates that the DSmT approach based 
on PCR5 rule performs better than the DST approach based on 
Dempster’s rule. 

Keywords — Context reasoning, sensor data fusion, smart media 
service 

I. Introduction 

Recently, from television to camera, traditional media 
consuming and generating devices are getting smarter by 
equipped with multi-functions, linked to other devices, and 
connected to the service systems or content markets. Media 
consumption environment is also getting smarter by equipped 
with multi-sensors and connected with service platfonns or 
management systems. In addition, the new devices supporting 
media consumption and generation have emerged with new 
abilities. Such change enables and empowers the evolution of 
media service to provide contents organically and smartly. 

For the smart media service upon the multiple smart 
devices within the smart environment, a confidential context 
reasoning scheme is required. In order to react in an 
appropriate way, perceived user activities need to be identified 
carefully to catch their needs or intends correctly. Data 
aggregation and fusion from multi-sensor and multi-source 
can generate more accurate and reliable context in a pervasive 
information environment. However, as much the confidence 
level of generated context is important, obtaining one is 
difficult because; 1) multiple sensors may provide unreliable 
information due to faults, operational tolerance levels, or 
corrupted data; 2) chance of inaccurate sensor readings can 
produce misunderstandings that lead to incorrect services; 3) 
some sensors provide information only at an abstract level, 



which can include uncertainty to some extent; and 4) it gets 
more ambiguous if data from multiple sensors are corrupted or 
conflicted. 

To perform the context reasoning that can produce a higher 
confidence level of contextual information, we adopt the static 
evidential fusion process (SEFP) proposed in [1]. Different 
from the DST approach based on Dempster’s rule, the [1] 
takes DSmT approach based on PCR5 rule. Hence, we execute 
both approaches with example smart media service scenario. 
The decision is taken by the maximum of the pignistic 
probability function and the results shows that the DSmT 
approach based on PCR5 rule produces less mass of ignorance 
and higher confidence level than that of the DST approach 
based on Dempster’s rule. 

In the rest of this paper, the context classification, 
modelling, and reasoning method to generate contexts for 
smart media service is described. We also demonstrate the 
context reasoning processes based on the proposed example 
scenario for smart media service. After comparing the results 
in terms of the mass of ignorance and confidence level, we 
conclude the paper. 

II. Context Classification, Modelling, and 
Reasoning Method 

A. Context Classification and modelling 

Before we perform the context reasoning, classifying the 
context of the situations for intended services is required. 
However, context classification is not easy since there are 
unlimited numbers of ways to describe an event or an object. 
Hence, in this paper, we define a relation-dependency based 
context classification and construct a state-space context 
modelling based on [9]. The dependency is a special type of 
relationship that exists not between entities and attributes but 
between associations themselves [7]. The dependencies 
between the objects or the sensors are not defined by the 
nature but by our interest, i.e., what we want to know. As the 
observation purpose or the goal of the context awareness 
differs, the dependencies between related objects or sensors 
gets different. Without the knowledge and understanding on 
such dependencies, appropriate decisions cannot be made by 
the context-aware service functions and can cause the wrong 
operations. Therefore, we consider the relation dependency 
approach based on spatial-temporal criteria. In this approach, 
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contexts are represented by three relation dependencies: 1) 
discrete facts; 2) continuous facts; and 3) client’s interaction. 
Then, following the state- space-based context modeling with 
an evidential form is defined in [9], static weighting factors of 
the selected data within the given time and location are 
applied to represent the quality of data. This context 
modelling consists of a hierarchical interrelationship among 
multiple sensors, related contexts, and relevant activities 
within a selected region. 

B. SEFP 

To obtain a higher confidence level of contextual 
infonnation, context reasoning is performed by the static 
evidential fusion process (SEFP) proposed in [1]. The 
procedures of the SEFP consist of seven steps: 

1) Represent the evidence on each sensor as a mass 
function in the evidential framework. 

2) Apply a static discounting factor (error rate) (r) into a 
sensor to get sensor credibility. 

3) Translate a multivalued mapping representing 
relationships between sensors and associated objects to 
make a context attribute. 

4) Aggregate context attributes and then translate to make a 
context state. 

5) Apply different static weighting factors to each context 
state to sum up context states. 

6) Apply the PCR5 rule to context states to achieve the 
consensus with the conflict mass and then to redistribute 
the partial conflicting mass. 

7) Calculate the belief levels, uncertainty levels, and the 
maximum of pignistic probability of each activity and then 
make a decision. 

Using evidential fusion processes such as the frame of 
discernment, the multivalued mapping, the combination rule, 
and the belief filter, context reasoning based on evidential 
fusion networks can be applied. In particular, we process 
sensor data with an evidential form based on the Dezert- 
Smarandache Theory (DSmT) [2]— [4] . DSmT reduces the 
uncertainty level and obtains a rational decision of contextual 
information using a proportional conflict redistribution 5 
(PCR5) combination rule [10] and a generalized pignistic 
transformation (GPT) [5]. The PCR5 rule redistributes the 
partial conflicting mass to the elements involved in the partial 
conflict, considering the canonical form of the partial conflict. 
The PCR5 rule is the most mathematically exact redistribution 
of conflicting mass to nonempty sets following the logic of the 
conjunctive rule [3]. Hence, the PCR5 rule is considered a 
combination rule in this paper. To take a rational decision, 
GPT generalizes the classical pignistic transformation (CPT), 
which has two levels of processes: 1) creedal (for combination 
of evidence) and 2) pignistic (for decision making) within the 
DSmT framework [11], [12]. The beliefs are represented by 
belief functions at the creedal level, and then, the beliefs 
induce a probability function at the pignistic level to make 
decisions. The decision is also taken by the maximum of the 
pignistic probability function. 



III. Applied Context Reasoning for Smart Media 
Service by SEFP 

A. Applied scenario 

When a client enjoys a media service, various situations can 
happen. Nevertheless, the most important contextual 
information is whether the client is interested in current 
content or not. Since the client’s interest can be regarded in 
many ways, to elaborate the ambiguity, we try to figure out 
whether the client is concentrated on watching the content or 
not. For this, we can monitor the client’s reactions or actions 
while consuming the content. The reactions can be detected by 
multiple sensors. For example, client’s face recognition and 
expression identification can be done by image comparison 
and analysis using photos taken by a camera deployed or 
embedded on the smart media device. Sound and motion are 
also good resources to catch the client’s mood and context, 
captured by an audio sensor and an infrared sensor also 
embedded or deployed on the device. On the other hand, the 
client’s actions can be detected directly by the input signals 
from the lights, remote controllers, and second screen devices 
(e.g., smart phone, touch pad, etc.). Those signals can be 
interpreted as the sign of distraction; if the client is really 
concentrated on the scenes playing on the screen, he/she 
would not take any actions especially changing environment, 
channel, or working on other devices. The simultaneous 
actions on second screen devices can be about the content 
currently watching, but still, while he/she takes the action, 
they cannot pay full attention to the screen. 

Thus, we utilize six types of different sensors in this 
scenario. Each sensor has a predefined threshold, and their 
operations can be represented by evidential forms. We can 
derive a SEN based on these simplified two cases, as shown in 
Fig. 1. We then find out more closely correct situations 
through context reasoning by calculating the belief, 
uncertainty, and maximum pignistic probability levels of each 
related activity. To calculate them, we assume that a 
discounting rate [error rate (r)] and a static weighting factor of 




Figure 1 . Example of a context reasoning for smart media service based on 

the SEN 
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each sensor are fixed. In addition, we assume that a static 
weighting factor of the motion sensor, the video sensor, the 
sound sensor, the light sensor, the control sensor, and the 
device sensor are 0.2, 0.3, 0.5, 0.1, 0.6, and 0.3, respectively. 
Three sensors — the video sensor, the sound sensor, and the 
control sensor — are not activated in Fig. 1 . 

To perform the context reasoning, firstly, we represent 
abbreviations for the motion sensor, Ms , the video sensor Vs, 
the sound sensor Ss, the light sensor Ls , the control sensor Cs, 
and the device sensor Ds in Fig. 1. We then represent a piece 
of evidence on each sensor as a mass function. We have 

= 1 ™ Vs ({-^Vs}) = \ 

m Ss ({^Ss}) = 1 m Ls ({Ls}) = \ 

r n Cs ({-^Cs}) = \ m Ds ({Ds}) = 1 

Second, we apply an error rate r to each sensor using to 
obtain credibility. Within our scenario, we assume that the 
motion sensor Ms has a 15% error rate, the video and sound 
sensor (Vs and Ss) have a 20% error rate, and the action 
detecting sensors (Ls, Cs, and Ds) have a 5% error rate when 
they are manufactured. In addition, we apply a multivalued 
mapping to represent the belief level of a context attribute by 
translating a mass function in [1]. We utilize abbreviations for 
the infrared I, the camera C, the audio A, the light L, remote 
controller R, and the second device D. We then aggregate 
context attributes and translate them into two related context 
states. A mass function on M, C, and A are translated onto the 
context state 1 (CS 1), and a mass function on L, R, and D is 
translated onto the context state 2 (CS2). 

Both CSl and CS2 are used for determining the relevant 
activities of the patient, i.e., 

™W{CS1}) = ™,({I}) = nf Ms ({Ms}) = 0.85 
m\ csi ({CSl, -.CSl}) = m l ({/, -./}) = m r Ms ( {Ms, Ms }) = 0.15 
w2 csl ({-.CSl}) = w c ({-,C}) = /<({-, Ks'}) = 0.80 
m2 CS] ({CSl, -.CSl}) = w c ({C,-,C}) = m;j{Vs,-,Vs}) = 0.20 
m3 csi ({-■CSl}) = m 4 ({-,Aj) = m^({-,Ss}) = 0.80 
w3 csl ({CSl,-.CSl}) = m A ({A,-,A}) = m' s ({Ss,-iSs}) = 0.20 
ml CS2 ({CS 2}) = m L ({L}) = m[ s ({Ls}) = 0.95 
M c ,, 2 ({CS2,-,CS2}) = m L ({L,^L}) = m r u ({Ls,^Ls}) = 0.05 
™2 CS1 ({-.CS2}) = ^({-,7?}) = m r Cs {{~^Cs}) = 0.95 
ot2 CjS2 ({CS2,-,CS2}) = m R ({R,^R}) = m r Cs ({Cs,^Cs}) = 0.05 
m3 CS2 ({CS2}) = m D ({D}) = m r Ds ({Ds}) = 0.95 
m3 CS2 ({CS2,^CS2}) = m D ({D,^D}) = m r Ds ({Ds,-,Ds}) = 0.05 

Third, we sum up a context state by adapting a different 
static weighting factor to each context attribute involved in the 
context context state. We assume that the weighting factor of 
CSl consists of I (20%), C (30%), and A (50%), and the 



weighting factor of CSl consists of L (10%), R (60%), and D 
(30%). We have 

m CSl ({CSl}) = (0.2)(M csl ) = 0.17 
m c „({^CSl}) = (03)(m2 csx ) + (0.5)(w3 csi ) = 0.64 
m csl ({CS\, -.CSl} ) = (0.2)(ml c „ ) + (0.3)(m2 csi ) 

+ (0.5)(m3 csi ) = 0.19 

m CS2 ({CS2}) = (0.1)(ml C52 ) + (0.3)(m3 CS2 ) = 0.38 
m csz ({^CS2}) = (0.6)(m2 CS2 ) = 0.57 
m CS2 ({CS2^CS2}) = (0.1)(ml CS2 ) + (0.6)(m2 CS2 ) 

+ (0.3)(w3 CS2 ) = 0.05 

We assume that both CSl and CSl can be used for inferring 
the concentrated (CC) and distracted (DD) situations of the 
client. In this paper, we calculate two mass functions ml cc 
and mice to identify the CC situation of the client, i.e., 

W l cc ({CC}) = Wcsi ({CSl}) = 0.17 
mlcc({^CC}) = >« csl ({-.CSl}) = 0.64 
ml cc ({CC,-.CC}) = w csl ({CSl,-iCSl}) = 0.19 
m2 cc ({CC}) = m CS2 ({CS2}) = 0.38 
W 2 cc ({-.CC}) = m CS2 ({-,CS2}) = 0.57 
m2 cc ({CC,-,CC}) = ot CS2 ({CS2,-,CS2}) = 0.05 

Fourth, by combining two sources as described in [1], we 
achieve the conjunctive consensus with the conflicting mass 
(£ 12 ). We then redistribute the partial conflicting mass using as 
follows: 

( m,(CC) m,(-.CC) m^CCU^CC)" 

"[m^CC) m 2 (-,CC) m 2 (CCU-.CC) y 
w 12 (0) = O m 12 (CC) = 0.1453 

m u (^CC) = 0.505 1 m l2 (CC U -.CC) = 0.0095 

k n =m n (CCr\^CC) 

= m, (CC)m 2 (-.CC) + m, (^CC)m 2 (CC) = 0.340 1 

m DS (CC) = m x ® m 2 (CC) =— ' — mJCG) = 0.2202 

1-*12 

m DS (-,CC) = -±—m n (^CC) = 0.7654 

l-k l2 

m DS (CC U -.CC) = m I2 (CC U -.CC) = 0.0 144 

! — *12 

After achieving the value of k i2 , the partial conflicting mass 
mi(CC)m 2 ( — 'CC) is distributed to CC and — CC proportionaly 
with the masses m x (CC) and m 2 ( — ] CC) assigned to CC and 
— CC, respectively. We suppose that Xi and y x is the 
conflicting mass to be redistributed to CC and — CC, 
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respectively, to calculate the first partial conflicting mass 
m x (CC)m 2 ( — CC ) as follows: 

— S— = ^ = hill = 0.1309 

m ,(CC) m,(^CC) (0.17) + (0.57) 

Thus, Xi = 0.0223, ji = 0.0746. 

In addition, the partial conflicting mass m 2 (CC)m x ( 1 CC) is 
proportionally distributed to CC and CC with the masses 
m 2 (CC) and m x ( — CC) assigned to CC and — CC, respectively. 
We suppose that x 2 and y 2 is the conflicting mass to be 
redistributed to CC and CC, respectively, to calculate the 
second partial conflicting mass m 2 (CC)m x ( — CC). We have 

^ =0.2384 

m 2 (CC) m ,(-.CC) (0.38) + (0.64) 

Thus, x 2 = 0.0906, y 2 = 0. 1526. 

We can obtain two results of the redistribution for each 
corresponding set CC and CC, respectively. We then obtain 
the result of the PCR5 rule as follows: 

m PCR5 (CC) = m l2 (CC) + x l +x 2 =0.2582 
m PCR5 (^CC) = m l2 (^CC) + y l +y 2 = 0.7323 
mp CR5 (CC U -.CC) = m l2 (CC U - CC) + 0 = 0.0095 



of pignistic probability of the PCR5 rule (PpcR 5 ({CC}) = 
0.2629) is higher than that of Dempster’s rule (P DS ({CC}) = 
0.2274), since PCR5 rule redistributes the partial conflicting 
mass to both positive and negative results of mass 
distributions concurrently. As a result, it is shown that the 
DSmT approach based on PCR5 rule is better than the DST 
approach based on Dempster’s rule. 

IV. Conclusions 

In this paper, we demonstrate an Evidential Fusion 
Network (EFN) based context reasoning for smart media 
service. For this we conduct the context classification and 
state-space based context modelling. Then, we perfonn the 
static evidential fusion process (SEFP) to obtain a higher 
confidence level of contextual infonnation. According to the 
results, the DSmT approach is better than the DST approach. 
In the future, we will improve the quality of a context by 
considering dynamic weighting factors, because correctly 
designing the quality of a context is an important factor for 
improving the contextual information of the client. 
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Finally, we calculate the belief and uncertainty level of the 
concentrated context with two combination rules using (1), (2), 
and (13) described in [1]. We then calculate the maximum of 
pignistic probability with a decision rule, i.e., 

Bel({CC}) = m DS ({CC}) = 0.2202 

Pl({CC}) = m DS ({CC}) + m DS ({CC, CC }) = 0.2346 

Pl({CC})-Bel({CC}) = m DS ({CC,^CC}) = 0.0144 

Bel({CC}) = m PCR5 ({CC}) = 0.2582 

Pl({CC}) = m PCR5 ({CC}) + m PCR5 ({CC, -.CC}) = 0.2677 

Pl({CC})-Bet({CC}) = m PCR5 ({CC,^CC}) = 0.0095 

P DS ({CC}) = m DS {{CC}) + ^m DS ({CC,^CC}) = 0.2274 
PpCR5 ({CC}) = 

m PCR5 ({CC}) + 

2 m PCR5 ({CC,—iCC}) 

= 0.2629 

In this scenario, we simply know that the mass of ignorance 
committed by the PCR5 rule (m? C R 5 (CC U — CC) = 0.0095) is 

less than that of Dempster’s rule (m D ^CC U CC) = 0.0144), 
because Dempster’s combination rule takes the total 
conflicting mass and then redistributes it to all nonempty sets, 
even those not involved in the conflict. In addition, when we 
compare the confidence level of the two cases, the maximum 
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